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We present a study of the phase diagram of a random optimization problem in presence of quantum 
fluctuations. Our main result is the characterization of the nature of the phase transition, which 
we find to be a first-order quantum phase transition. We provide evidence that the gap vanishes 
exponentially with the system size at the transition. This indicates that the Quantum Adiabatic 
Algorithm requires a time growing exponentially with system size to find the ground state of this 
problem. 
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PACS numbers: 75.10. Nr; 03.67.Ac; 64.70. Tg 

Theoretical research on quantum computing is moti- 
vated by the exciting perspective of computers that take 
intrinsically advantage of the laws of quantum mechanics. 
Besides the great effort of research towards the physical 
realization of these devices, a lot of activity has been de- 
voted to the development of algorithms that could use 
quantum properties to achieve a faster velocity in per- 
forming computational tasks with respect to classical de- 
vices. A typical problem that is encountered in almost 
all branches of science is that of optimizing irregularly 
shaped cost functions: the Quantum Adiabatic Algo- 
rithm (QAA) 0, S] is in principle able to tackle such 
problems in a universal way. Suppose one wishes to 
find the ground state of a Hamiltonian Hp acting on 
N qubits. To perform the QAA one considers a simpler 
Hamiltonian Hq, such that the quantum computer can 
be easily initialized in its ground state. If one slowly 
interpolates the Hamiltonian H(t) of the quantum com- 
puter from Hq to Hp, the adiabatic theorem ensures 
that, with high enough probability, the system will re- 
main at all times in the ground state of the interpolating 
Hamiltonian. Hence, at the end of the evolution, it will 
be in the ground state of Hp and the original problem will 
be solved. The crucial question is of course, how slow the 
evolution should be in the thermodynamic limit TV— >oo. 
Quite generally, the adiabaticity condition requires the 
rate of change of H(t) to be smaller than the (squared) 
gap between the ground state and the first excited state 
of H{t). Hence, the time needed to ensure adiabatic- 
ity will diverge in the thermodynamic limit whenever a 
quantum phase transition, at which the gap is expected 
to vanish 3| , is encountered during the interpolation be- 
tween Hq and Hp. It is well established that the gap 
vanishes at least polynomially in TV at a quantum second- 
order critical point [3( (except in some cases in presence 
of disorder Q), while it vanishes exponentially in N at a 
first-order phase transition [H-01 ■ First-order phase tran- 
sitions are thus particularly dangerous for the QAA. 

The formal computational complexity theory classifies 



the difficulty of a problem according to a worst-case crite- 
rion. It might, however, well be that "most" of the prob- 
lems in a given class are easy, even though a few atypical 
instances are very difficult. To give a precise content to 
this notion of typicality the research has turned to the 
study of random instances, defining a probability distri- 
bution on the space of instances. Statistical mechanics 
tools have provided a very detailed and intricate picture 
of the properties of the configuration space of such typical 
problem Hamiltonians Hp [8(. Random instances were 
also used to benchmark the performance of the QAA, 
and early results generated considerable excitement by 
reporting polynomial scaling of the minimum gap for 
sizes up to N ~ 100 @, @|. However, some evidence 
of the presence of first-order phase transitions has been 
recently reported 0-0] , which is natural from the point 
of view of mean- field quantum spin glasses (loj . These 
studies rely on numerical investigations of small systems 
(N < 256) and/or on perturbation theory close to Hp, 
hence they should be completed by a non-perturbative 
analytic treatment in the thermodynamic limit. 

This is what we achieve in this Letter, reporting the re- 
sults of the first analytical study of a random, quantum, 
finite- connectivity optimization problem (namely, random 
regular 3-XORS AT in a transverse field) , that is believed 
to be largely representative of the generic behavior of 
these problems. We compute the complete phase dia- 
gram of the model in the thermodynamic limit N — > oo 
and for a uniformly random distribution of instances, as 
a function of temperature and transverse field. This is 
possible thanks to the quantum cavity method, recently 
introduced in [IH and further developed in [l2| (see [l3| 
for related work), that allows to solve exactly these prob- 
lems by generalizing to the quantum case the method de- 
veloped for classical models [14l |. Our main result is the 
occurrence of a first-order phase transition at zero tem- 
perature as a function of the transverse field. We corrob- 
orate the analytical results with Exact Diagonalization 
and Quantum Monte Carlo data. We provide evidence 
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FIG. 1: (Top) Phase diagram of Eq. JTJ) for c=3. Open sym- 
bols are results of the RS calculation: first-order transition 
line separating the CP and QP (circles), with the correspond- 
ing spinodals (diamonds) . Full symbols are the result of the 
1RSB calculation: squares, clustering transition separating 
the CP and dCP. (Bottom) Energy and m, as a function 
of r for temperature T — 0.05. MC data for a sample with 
N = 2049. 



that the gap vanishes exponentially in the size of the 
system at the transition. These results strongly suggest 
that the QAA requires an exponentially large time in N 
to find the ground state of this problem. 

Methods. — We focus on the random c-regular 3- 
XORSAT problem 15J , that in spin language is defined 
by the Hamiltonian 
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H P + H Q = J2(i- J„44<r|)-r^< . (1) 
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Here, J a — ±1 with equal probability. The 3 spins 
«X)**2)*3 involved in clauses a = 1, ••■ ,M = Nc/3 are 
chosen uniformly at random among all possible choices 
such that each spin enters exactly in c clauses. In the 
classical limit T — 0, a given instance of the system is 
called satisfiable (SAT) if there is a ground state of zero 
energy, UNSAT otherwise. 

The thermodynamic properties of the model in the 
thermodynamic limit N — > oo, and on average over 
the disorder, can be obtained by means of the cavity 
method [3]. For quantum models, the cavity method al- 
lows to reduce the solution of the model to the problem 
of finding the fixed point of a functional equation for the 
local spin effective actions ll|, |l2j (this functional equa- 




FIG. 2: (Top) Phase diagram of Eq. {T} for c = 4. Symbols 
as in Fig. [I] with the addition of the spin-glass transition line 
(full triangles); the correct first-order transition line is ob- 
tained from the IRSB calculation (full circles). (Bottom) En- 
ergy and m x as a function of T for temperature T = 0.05. MC 
data for N = 120 and averaged over 20 samples (full symbols) 
and extrapolated in 1/N to the N— >oo limit (open symbols). 
Black curve, starting from the classical ground state found us- 
ing an exact MAXSAT solver Red curve, starting from 
the QP. 



tion being solved numerically as in 12j with a population 
dynamics algorithm 14|). In presence of one single pure 
state, the method discussed in [HI, [12], that goes under 
the name of replica symmetric (RS), is enough to obtain 
the correct solution. However, in order to describe the 
low-temperature glassy phase, which is characterized by 
a large number of pure states, one has to introduce a gen- 
eralization of the RS cavity method that goes under the 
name of one-step replica symmetry breaking (IRSB) [l4j . 
This generalization, that we introduce here for the first 
time in the context of quantum diluted models, proceeds 
along the line of the classical computation (see 15[ for the 
solution of (Q} at T = 0) using as variables the imaginary- 
time spin trajectories as detailed in I2J. Additionally, for 
finite N, we performed Exact Diagonalization (ED) us- 
ing the Ritz functional method [l6| , and Quantum Monte 
Carlo (QMC) simulations using the heat-bath algorithm 
introduced in (l2| . 

Results of the cavity method. — In the classical limit 
[l^ l when r = 0, the model is SAT (with a probability 
going to 1 as N -> oo) for c < 3, UNSAT for c> 3, while 
in the marginal case c = 3 it is SAT with finite proba- 
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FIG. 3: Lowest energy levels from exact diagonalization of a 
USA instance with c = 3 and N = 15. In the inset the region 
close to the phase transition is magnified. 

bility. Let us begin the description of our results with 
the simpler case c = 3. The RS computation predicts, 
at low enough temperature T < 0.24, a first-order transi- 
tion between two different paramagnetic (m z = (erf) = 0) 
phases: the Classical Paramagnet (CP) characterized by 
a small value of transverse magnetization m x — (erf), and 
the Quantum Paramagnet (QP) that has a larger value 
of m x . This transition and the corresponding spinodals 
are shown in the (r, T) phase diagram of the top panel in 
Fig.[TJ the transition is found around T C (T) w 1.0 for all 
values of T < 0.24. We also report in the bottom panel 
of Fig. [1] the cavity method predictions for m x and the 
energy density e = (H) /N at very low temperature. The 
outcome of the 1RSB computation is twofold: it confirms 
that the RS computation of the thermodynamic observ- 
ables is in this case correct in the whole phase diagram 
(r, T), in particular they are singular only on the RS 
transition line. Moreover it unveils that, for low enough 
values of T and T the CP phase is actually a "dynam- 
ical CP", in technical terms a 1RSB phase with Parisi 
breaking parameter x equal to 1, where an exponential 
number of pure states coexist. The attribute dynami- 
cal, taken from the literature on classical mean-field spin 
glasses and optimization problems [H, emphasizes that 
equilibrium thermodynamic properties are unaffected as 
one crosses the line between CP and dCP (also plotted 
in Fig. [J). 

We turn now to the c = 4 case (which is representative 
of the behavior for any c > 3), for which the results are 
displayed in a similar fashion on Fig. [5] It has a richer 
phenomenology very similar to the one of fully-connected 
mean- field models [10| . Indeed the dCP undergoes a ther- 
modynamically second-order phase transition to a true 
Spin-Glass (SG) phase (with a sub-exponential number 
of pure states and x < 1). At low enough temperature 
the thermodynamic transition becomes first order, be- 
tween the 1RSB SG and the QP. For this reason, the 
RS computation gives a wrong result for the first-order 
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FIG. 4: Data for c = 3 on USA instances. (Main panel) Aver- 
age of the minimal gap A m i n as a function of N. Dashed line 
is a fit to A m in(iV) = 0.911 exp(-0.081A r ). Inset: average of 
[dm^/drjmax. In both cases, error bars are of the order of the 
symbol size except when explicitly shown (N = 24). Dashed 
bars represent the standard deviation of a single realization 
of the random variables A m i n and [dm x /dT] max . 



transition line, see top panel of Fig. [2j In both cases we 
conclude on the existence of a first- order quantum phase 
transition at T — T c and zero temperature, separating 
the dCP (for c = 3) or the SG (for c = 4) from the 
QP. The transition extends in a line T C (T) at low enough 
temperature, which is almost independent of T . 

Numerical investigations. — A first instructive exam- 
ple of the relevance of this transition is found by com- 
paring the cavity results with QMC (Figs. [TJ [2] lower 
panel). We first run a QMC starting from the classi- 
cal ground state at V — and slowly increasing T. For 
c = 3, instances have a finite probability of being SAT, 
and otherwise have an energy of order 1/N (see below 
and [Hj]): since SAT instances can be solved in polyno- 
mial time using the Gauss elimination algorithm, we can 
limit ourselves to the study of this simple case, and we 
can then run the QMC for very large sizes (N = 2049). 
For c = 4, the problem is typically UNSAT [l5j], finding 
the ground state is very hard (actually, NP-hard), and 
we are limited to much smaller sizes (N < 120); yet a 
good extrapolation in 1/N to the thermodynamic limit 
is possible. In both cases we find that the QMC data 
follow closely the cavity result for the dCP or SG phases, 
respectively. As expected for a first-order transition, we 
find some hysteresis around T c before the system finally 
jumps to the QP phase. We then consider a more in- 
teresting QMC run starting from large T = 2 in the QP 
phase and slowly decreasing T. For both c = 3,4, QMC 
data follow the cavity ones down to the transition, but 
in both cases, the energy remains extensively higher than 
the ground-state energy for any T < T c . This is already 
an important indication of the difficulty in finding the 
ground state in the dCP and SG phases, even in pres- 
ence of quantum fluctuations. 
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We have further investigated the consequences of the 
transition at F c for the QAA by investigating with ex- 
act diagonalization tools the dependence on T of the 
low-energy part of the spectrum of H for small sizes. 
To unambiguously define the gap A(r) between the 
ground state of H and its first excited state at all val- 
ues of r, we concentrated on instances of Hp having a 
Unique Satisfying Assignment (USA), i.e., a single clas- 
sical ground state. For c = 3 and N — > oo, the fraction 
of SAT and USA instances are / S at = 0.609 ± 0.003 and 
/usa = 0.2850 ±0.0022, as determined by using a Davis- 
Putnam-Logemann-Loveland-like algorithm to count the 
number of solutions of 40000 instances [3] • Since USA 
instances are a finite fraction of the uniform ensemble, 
they can be easily constructed. The spectrum of a typi- 
cal USA instance of N = 15 spins is reported in Fig. [3] 
We observe, as expected, that the gap A(r) has a min- 
imum A m j n close to the phase transition at T c (recall 
that r c rs 1 for c = 3 at N — > oo). Around the same 
r c , m x changes abruptly, hence its derivative has a large 
maximum [dm x / dT] max . In Fig. [4] we show the behavior 
of the average A m ; n and [dm x /dT] max as a function of 
N. Our data are clearly consistent with an exponential 
scaling of the gap, which is expected in presence of a first- 
order transition (see [H for a discussion on how to com- 
pute the prefactor in the exponential in fully-connected 
models), and an exponential divergence of [dm x /dT] max . 
The probability distribution over instances of A m ; n and 
[dm x /dT] max has a unique peak close to their average, 
and its variance is also reported in Fig. |4] (dashed bars). 
This shows that all instances undergo a first order tran- 
sition of the same kind in the thermodynamic limit. 

Let us finally suggest that the main differences between 
our observations and the ones of 0, 0| arises from the 
method of construction of instances. Most random op- 
timization problems that undergo a SAT-UNSAT tran- 
sition as a control parameter is continuously tuned still 
have an exponential number of ground states right before 
they become UNSAT. Conditioning on USA instances 
is thus, contrary to the case studied in this Letter, an 
exponentially rare event which restricts the study to ex- 
tremely atypical instances and that also forbids the con- 
struction of large instances. There exists however a nat- 
ural family of difficult optimization models (e.g., Eq. ([1]) 
with c = 4 and J a = 1 Va) which have unique ground 
states with probability 1 in the thermodynamic limit [l9| . 
This is thus a practical way of generating large USA in- 
stances as typical ones in a uniform random ensemble. 

Conclusions. — We have obtained the full phase di- 
agram of the quantum regular XORSAT optimization 
problem as a function of T and T. Our main results 
are: i) There is a first-order quantum phase transition 
at T = between a Paramagnetic or a Spin-Glass phase 
and a Quantum Paramagnetic phase, at a critical value 
of r = T c ; ii) The transition is due to a crossing be- 
tween the low-r classical-like ground state, and the high- 



r quantum paramagnetic state. It is of very different 
nature from the level crossing at infinitesimal T between 
different spin-glass ground states discussed in @; Hi) The 
first-order transition is observed for almost all instances, 
even for very small N; iv) The transition is associated 
to an exponentially vanishing gap of H, hence the Quan- 
tum Adiabatic Algorithm requires a run time scaling ex- 
ponentially with system size. These results indicate that 
quantum adiabatic computations, at least in their origi- 
nal formulation [l], 0| , fail for difficult optimization prob- 
lems. 

The method introduced here is not restricted to XOR- 
SAT, and can be applied to investigate other random 
optimization problems, such as, e.g., the exact cover dis- 
cussed in 0, 0, HI or random iGSAT. Another closely 
related problem is MAP decoding of LDPC codes. The 
study of these problems should be very interesting, since 
in the classical case they typically have exponentially 
many solutions even at the SAT-UNSAT transition. This 
huge degeneracy will be partially lifted by adding a trans- 
verse field, but we expect the low energy spectrum of 
these problems to be quite complicated, and character- 
ized by many almost-degenerate low energy states. What 
is the precise definition of the relevant gap for the QAA in 
these cases is clearly an interesting problem. It is, how- 
ever, rather natural, based on the accumulated knowl- 
edge on classical optimization problems @ and mean- 
field spin-glasses [a El, to believe this first-order tran- 
sition, and thus the failure of the QAA to be a generic 
feature in these problems. Yet, the instances that are 
encountered in practical applications are often very dif- 
ferent from the random instances investigated here: the 
latter are characterized by a locally tree-like graph, while 
the former have more structure. Extending these results 
to more realistic instances is an important direction for 
future research. 

We wish to thank B. Altshuler, J. Roland and 
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